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fications  or  other  data  are  used  for  any  purpose 
other  than  in  connection  with  a  definitely  related 
government  procurement  operation,  the  U.  S. 
Government  thereby  incurs  no  responsibility,  nor  any 
obligation  -lAatsoever;  and  the  fact  that  the  Govern¬ 
ment  may  have  formulated,  furnished,  or  in  any  way 
supplied  the  said  drawings,  specifications,  or  other 
data  is  not  to  be  regarded  by  implication  or  other¬ 
wise  as  in  any  manner  licensing  the  holder  or  any 
other  person  or  corporation,  or  conveying  euiy  rights 
or  permission  to  manufacture,  use  or  sell  any 
patented  invention  that  may  in  any  way  be  related 
thereto. 
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SUMMARY 


As  pointed  out  In  the  introduction, jjjistead  of  the  customary 
proof  of  the  existence  of  an  optimal  basis  in  the  simplex  method 
based  on  perturbation  of  the  constant  terms  -we-oharllr^iw  a  new 

f -S  t  f 

proof  based  on  inductl^y  P^om  a  pedagogical  point  of  view  it 
permits  an  earlier  and  more  elementary  proof  of  the  fundamental 
duality  theorem  via  the  simplex  method.  Specifically  we  shall 
show  that  there  exists  a  finite  chain  of  feasible  basis  changes, 
which  results  in  either  an  optimal  feasible  solution  or  in  an 
infinite  class  of  feasible  solutions,  such  that  the  objectlre 
form  tends  to  minus  infinity. 
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INDUCTIVE  PROOF  OP  THE  SBIPLEX  METHOD 
George  B.  Dantzig 

Instead  of  the  customary  proof  of  the  existence  of  an 
optimal  basic  set  of  variables  in  the  simplex  method  based  on 
perturbation  of  the  constant  terms  we  shall  give  a  new  proof 
based  on  Induction  [l] .  Prom  a  pedagogical  point  of  view  It 
permits  an  early  elementary  proof  of  the  fundamental  duality 
theorem  via  the  simplex  method,  which  is  favored  by  some  [2]  . 

■nie  general  linear  programming  problem  Is  to  find  x  ^  0 
and  Min  2  satisfying 


(1) 


^11^1  ^12^2  ■* 
^21^1  ^22^2 


^In'^n  =  ^1 
^2n^n  =  ^2 


^ml^l  ^  ^ni2^2  +  a^x^  . 

®1^1  •  H-  c  X  =  z. 

n  n 


Our  objective  is  to  prove  the  following: 
Theorem;  If  a  basic  feasible  soi-^^-  ^ 
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Proof ;  Let  the  canonical  form  for  (l)  with  respect  to  the 
assumed  Initial  set  of  basic  variables,  say  x^, 


(2)  X, 


^lm+1  \i+l  ^  ^  ^Is  ^s  ■^  *  *  *  “^  ^ln*n  “  ^1 


fit  .  X.  *  -t-  •  •  •  4*  4"  •  •  •  4*  St  ^  b 

rm+l  ^4-1  2s  s  rrt  n  r 


^  ^m,m+l^m+l 


4-  •  •  •  +  a  X  4-  •••  4-  a, 
ms  s 


mn*n  ^m 


°m4l  ^n+1  -»  •••+  Os  °n  ^n  “  ^“^0 


where  Zq  is  a  constant  and  are  the  new  values  of  the  co¬ 
efficients  resulting  by  the  elimination  of  ^i>****\i  from  all 
but  one  of  the  equations  and  the  ^  0  for  1=1, 2,..., m.  TTie 
basic  feasible  solution  is  obtained  by  assigning  the  norv-basic 
variables  the  values  zero  and  solving  for  the  values  of  the 
basic  variables.  Including  z. 

The  simplex  method  may  be  outlined  as  follows.  Each 
iteration  begins  with  a  canonical  form  with  respect  to  some 
set  of  basic  variables.  Ihe  associated  basic  solution  is  also 
feasible  ,l.e.  the  constants  To^  (as  modified)  remain  nonnegative. 
The  procedure  terminates  when  a  canonical  form  is  achieved  for 
which  either  the  ^  0  for  J  (in  which  case  the  basic 
feasible  solution  is  optimal),  or  else,  in  some  column  with 
c„  <  0,  the  coefficients  are  all  nonpositive  a,  ^0,  (in  which 
case  a  class  of  feasible  solutions  exists  for  which  z  —  00). 
In  all  other  cases  a  "pivot"  term  is  selected  in  a  column,  s, 
and  row,  r,  such  that  "Cj,  ■=  Min  Cj  is  <0  and  =  Min 

for  a  .  a.  positive.  The  variable  x„  becomes  a  new  basic 

rs'  is  '  s 
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variable  replacing  one  In  the  basic  set  —  namely  by  using  the 
equation  with  the  pivot  term  to  eliminate  from  the  other 
equations.  When  the  coefficient  of  the  pivot  term  Is  adjusted 
to  be  unity,  the  modified  system  Is  In  canonical  form,  and  a 
new  basic  feasible  solution  Is  available  In  which  the  value  of 
z  «=  Is  decreased  a  positive  amount  If  )>  0.  In  the  non- 
degenerate  case,  we  have  all  B’^'s  positive.  If  this  remains 
true  from  Iteration  to  Iteration,  then  a  termination  must  be  • 
reached  In  a  finite  number  of  steps,  because  (l)  each  canonical 
form  is  uniquely  determined  by  choice  of  the  m  basic  variables; 
(2)  the  decrease  In  value  of  Implies  that  all  the  basic  sets 
are  strictly  different;  (3)  the  number  of  basic  sets  Is  finite; 
indeed,  not  greater  than  (m). 

In  the  degenerate  case  It  Is  possible  that  b^  =  0;  this 
results  In  Zq  having  the  same  value  before  and  after  pivoting. 

It  has  been  shown  (by  examples  due  to  Hoffman  and  Beale)  that 
the  procedure  can  repeat  a  basic  set  and  hence  cycle  Indefinitely 
without  termination.  This  phenomenon  occurs  (as  can  be  In¬ 
ferred  from  what  follows)  when  there  is  ambiguity  In  the  choice 
of  pivot  term  by  the  above  rules.  A  proper  choice  simong  them 
will  always  get  around  the  difficulty.  To  show  this  we  make 
the  following  — 

Inductive  Asstunptlon;  We  assime  for  l,2,...^m— 1  equations  that 
only  a  finite  number  of  feasible  basic  set  changes  are  required 
to  obtain  a  canonical  form  such  that  the  z  equation  has  all 
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nonnegative  coefficients  (o’*  y  O)  or  some  column  s  has  "c  ^0 

J  s 

and  all  nonpositive  coefficients  (a^^^  ^  O). 

We  first  show  the  ti*uth  of  the  Inductive  assumption  for 
ni=l.  If  the  Initial  basic  solution  Is  non-degenerate,  )>  0, 
then  we  note  that  each  subsequent  one  Is  also.  It  follows  that 
the  flnlteness  proof  of  the  simplex  method  outlined  above  Is 
valid,  so  that  a  final  canonical  form  will  be  obtained  that 
satisfies  our  Inductive  assiunptlon.  T5ie  degenerate  case  =  0, 

Is  established  by  Invoking  the  following  convenient  lemma; 

;  If  the  Inductive  assumption  holds  for  m,  where  not  all 
Initially  zero,  then  It  holds  when  all  are  zero. 

Proof:  Change  one  or  more  F^  =  0  to  F^  =  1  (or  any  other  positive 
value)  and  then,  by  hypothesis,  a  sequence  of  basic  set  changes 
exists  such  that  the  final  one  has  the  requisite  properties.  If 
exactly  the  same  sequence  of  pivot  choices  are  used  for  the 
totally  degenerate  problem,  eaoh  basic  solution  remains  feasible 
(namely  zero).  Since  the  desired  property  of  the  final  canonloal 
form  depends  only  on  the  choice  of  basic  variables  and  not  on  the 
right-hand  side,  the  lemma  Is  demonstrated. 

To  establish  the  Inductive  step,  suppose  our  Inductive 
assumption  holds  for  l,2,...,m-l  and  that  F^^  +  0  for  at  least 
one  1  In  the  m  equation  system  (2).  If  we  are  not  at  the  point 
of  termination,  then  the  iterative  process  is  applied  until 
on  some  iteration,  a  further  decrease  in  the  value  of  "Zq  Ib 
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not  possible,  because  of  degeneracy.  By  rearrangement  of 
equations,  let  =  Fg  =  ...  «  -  0  and  +  0  for  l=r+l,...,ra. 

Note  for  ^  Iteration  that  r  <  m  holds  because  It  Is  not  possible  to 
have  ^tal  degeneracy  on  a  subsequent  cycle  If,  as  assumed,  at  least 
one  of  the  F^  4"  0  Initially.  According  to  our  Inductive 
assumption  there  exists  a  finite  series  of  basic  set  changes 
using  pivots  from  the  first  r  equations  that  results  in  a  sub¬ 
system  satisfying  all  c ^  ^  0  or,  for  some  s,  all  a^^  ^  0, 

^  ^  ^  ^  ^  °s  ^  Since  the  constant  terms  for  the  first 
r_equatlons  are  all  zero,  their  values  will  all  remain  zero 
^roughout  the  sequence  of  pivot  term  choices  for  the  subsystem; 

^hls  means  we  can  apply  the  same  sequence  of  choices  for  the 
entire  system  of  ni  equations  without  replaclnp;  ^ 

Msl_c  variables  or  changing  their  values  In  the  basic  solutions. 

If  the  final  basis  for  the  subsystem  has  all  ^  0,  then 
the  same  property  holds  for  the  system  as  a  whole.  On  the 
other  hand  suppose  the  final  basis  of  the  subsystem  has  for 
some  8,  Cg  <  0  and  ^  o  for  1=1, 2,..., r;  in  this  case  we 

^  ®  l=r+l,,..,m  (in  which  case  the  Inductive 

property  holds  for  m)  or  else  the  variable  can  be  Introduced 

Into  the  basic  set  for  the  system  as  a  whole,  producing  a 

decrease  In  since  F^  >  0  for  l-r+l,...,m.  We  have 
seen  earlier  that  this  value  of  z  can  decrease  only  a  finite 
number  of  times.  Hence,  the  Iterative  process  must  terminate 
but  the  only  way  It  can  is  when  the  Inductive  property  holds 
for  the  m  equation  system. 
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This  completes  the  proof  for  m  equations,  except  for  the 
completely  degenerate  case  where  =  0  for  all  1*1,2, 

The  latter  proof,  however,  now  follows  directly  from  the  lemma. 
Q.E.D. 
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